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A detailed description of the quantification of uncertainties for the Ares I ascent aero 
6-DOF wind tunnel database is presented. The database was constructed from wind tunnel 
test data and CFD results. The experimental data came from tests conducted in the Boeing 
Polysonic Wind Tunnel in St. Louis and the Unitary Plan Wind Tunnel at NASA Langley 
Research Center. The major sources of error for this database were: experimental error 
(repeatability), database modeling errors, and database interpolation errors. 
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shifted forward) 

database value of coefficient at nominal breakpoints 
baseline Cl database, derived from wind tunnel data 

coefficient value of wind tunnel data-derived database, includes BDM increments 
coefficient value of CFD solutions obtained at flight Reynolds number conditions 
coefficient value of CFD solutions obtained at wind tunnel Reynolds number conditions 
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alternate version of C DB C i, constructed without smoothing, used to quantify database modeling errors 
body axis axial force coefficient 
body axis rolling moment coefficient 

body axis pitching moment coefficient, moment reference center 13.88 diameters forward of nozzle 
gimbal point 

body axis yawing moment coefficient, moment reference center 13.88 diameters forward of nozzle 
gimbal point 

body axis normal force coefficient 
body axis side force coefficient 

1%-scale Ares I A 106 model configuration with all protuberances 

1%-scale Ares I A 106 model configuration with no protuberances, axisymmetric model 

C4 coefficient data with biases removed, 'clean' axisymmetric data 

Cl configuration with BDMs shifted forward 

coefficient value obtained by querying the database response surface at non-canonical inference space 
points 

prefix for coefficient residuals 
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degrees of freedom 

slope in linear model of flight Reynolds number aero coefficients 

abbreviation for 'flight' 

range (maximum value - minimum value) 

average range 
Reynolds number 
standard deviation 

uncertainty associated with database query 

database interpolation error 

database modeling error 

net database modeling error, in Eq. (10) 

database modeling error for CFD-based Reynolds number increment model 

uncertainty due to experimental error 

uncertainty associated with the linear model of Eq. (12) 

uncertainty quantification 

abbreviation for 'wind tunnel' 

offset in linear model of flight Reynolds number aero coefficients 
standard deviation for experimental within-test repeatability 
coefficient increment of wind tunnel-to-flight Reynolds number effects 


I. Introduction 

A statement of uncertainty is desired for any aerodynamic database, in addition to the best-value response 
surface for the predictions. The statement should include the effects of all of the significant sources of 
uncertainty. In this paper, the user-interpolated (queried) value in the database response surface for any of the six 
aero force and moment coefficients is designated as Cg. Then the true value, C T rue, is defined in Eq. (1), where U c ,q 
is the estimated error bound for Cq. 


c =c +u 

'-TRUE y - / Q~' J C,Q 


(1) 


This paper presents a description of the uncertainty modeling of the Ares I A106 ascent aerodynamics 6-DOF 
database. Error bounds were estimated for all processes used to generate the data and to modify these data during 
database construction. This includes wind tunnel repeatability errors, database modeling errors, and database 
interpolation errors. The individual uncertainties were combined by the root-sum-square (RSS) method. It was also 
assumed that the errors are samples from a random variable and that errors from different sources are independent 
and uncorrelated. 

The A 106 ascent database was constructed using both experimental and CFD data. The experimental data was 
obtained during wind tunnel tests conducted in the Boeing Polysonic Wind Tunnel (PSWT) and the NASA Langley 
Research Center Unitary Plan Wind Tunnel (UPWT) on a 1% scale model. Data from the PSWT test were obtained 
at Mach numbers from 0.5 to 1.6, and UPWT testing was conducted at Mach numbers ranging from 1.6 to 4.5. 

Wind tunnel data from three model configurations were used in the database construction. These configurations 
were: the model with all protuberances (Cl), the Cl configuration with booster deceleration motors (BDM) shifted 
forward (C7), and a "clean" axisymmetric configuration with no protuberances (C4). At the time of these wind 
tunnel tests, the location of the BDM's on the vehicle had not been finalized. Therefore data were obtained for both 
BDM positions (Cl and C7). During these A106 wind tunnel tests roll run data were obtained at total angles of 
attack ranging from 0° to 10° and pitch runs were obtained at roll angles every 45°. 

II. Ares I A106 Ascent Database Construction 

The A106 ascent aero database consisted of three components: an experimentally-derived response surface of the 
Cl configuration, a wind-tunnel-to-flight Reynolds number increment model (constructed from CFD data), and 
BDM increments (constructed from wind tunnel data). The Cl configuration is not axisymmetric, due to all of the 
protuberances. In order to minimize the effect of systematic errors from the wind tunnel tests, a strategy was 
developed during the previous design phase (A103) to remove these errors from the database. With this strategy, the 
baseline Cl database was constructed by adding Cl increments (Cci -Cc 4 ) to results from the axisymmetric model 
(C4), and invoking symmetry or anti-symmetry where appropriate. This approach is consistent with the way the 
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wind tunnel database was constructed in the previous design phase (A103). 1 The A106 database is a function of 
Mach number, pitch angle, and roll angle. The buildup of the final A 106 ascent database is defined in Eq. (2). 

CdB = ( Cci - Cc4 j + Cc4, adjusted + (Cc7~ Cci) + ACpltRe, CFD (2) 

The first three terms in Eq. (2) were constructed using wind tunnel data and the last term was developed from 
CFD results. The first term represents the increments due to the protuberances. The second term, C C 4, adjusted, 
represents the C4 pitch data, which have been adjusted for symmetry, anti-symmetry, and axisymmetry where 
appropriate. This particular term represents a "clean" baseline to which increments due to protuberances (C1-C4) 
and BDMs-forward (C7-C1) are added. The adjusted C4 data and the configuration increments are presumed to be 
free of systematic errors. It is assumed that by subtracting data from two configurations that the systematic errors are 
naturally subtracted out. The adjustments made to create the C C 4 , adjusted term include shifting all coefficients (except 
axial force) to zero at zero degrees total angle of attack. 

III. General Description of Database Error Modeling 

For any database using a combination of CFD and experiment, the uncertainty is composed generally of four types 
of terms: 

1. Experimental error associated with the adjusted wind tunnel dataset used to build the database response 

surface (i.e., wind tunnel data repeatability, U EX p) 

2. Curve-fit error associated with creating the database response surface from the computational dataset or the 

adjusted experimental dataset (database modeling error, U DBM ) 

3. Errors associated with the validation models for the CFD dataset 

4. Error from linear interpolation in the database response surface by the user (database interpolation error, 

Udbi) 

There were not sufficient CFD data to develop a detailed CFD validation model, so the error type defined in #3 
above was not expressed in the overall A 106 database uncertainty model. A general expression of the error buildup 
for this database is described in Eq. (3). 


u 2 

U C,Q 


=u +u +u 

EXP T DBM T DBI 


( 3 ) 


The A 106 combined baseline database contains experimental errors, database modeling errors for the 
experimentally-derived Cl response surface, and database modeling errors for the Reynolds number increment 
model. The database interpolation error was computed from the final database release and combined with the other 
database error components. A discussion of these errors and how they were combined into a total error for the 
complete ascent database is presented in the following sections. 

All analyses presented in this paper were done in body axis coefficients. Normal force and side force 
coefficients, as well as pitching and yawing moment coefficients, were combined to perform this error analysis, as 
they are similar in magnitude and behavior in the body axes. 


IV. Experimental Errors in Database 


A. Within-Test Repeatability 

Wind tunnel tests were conducted on a 1%-scale Ares I A106 CLV model in the Boeing Polysonic Wind Tunnel 
(PSWT) and the NASA LaRC Unitary Plan Wind Tunnel (UPWT). 2 ’ 3 A quantitative analysis was performed on 
groups of replicate runs obtained during the 1%-scale A 106 CLV wind tunnel tests to quantify the within-test 
repeatability of the experimental data, <r rep . 4 

There were numerous pairs of replicate runs obtained at a range of Mach numbers during each wind tunnel test. 
Repeat runs were obtained for both pitch and roll runs. For each set of replicate runs, the data were interpolated to 
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nominal angles. The wind tunnel facilities were generally very accurate in setting the desired angles, so this 
interpolation was minimal. For each pitch or roll angle, the absolute value of the difference (i.e., range, R) between 
the coefficients at replicate points was computed. Then the average of the ranges for a given replicate run set was 
computed, and the standard deviation was estimated using Eq. (4). 5 

R 

a, ' ep ~ 1.128 (4) 

The results from Eq. (4) were plotted versus Mach number. A final estimate of the repeatability was determined 
by comparing the A106 repeatability standard deviations to those computed for previous configurations. 6 7 Figures 1 
through 4 show the final repeatability standard deviations determined for the A 106 configuration in body axis 
coefficients. The average repeatability from earlier Ares configurations A101 and A 103 are shown in red on the 
figures. The black symbols represent the repeatability sigmas computed with Eq. (4) above. The dashed lines in 
Figure 1-4 represent the final standard deviations chosen to represent the A 106 repeatability. The final A 106 
repeatability sigmas were determined by drawing a smooth curve roughly between the computed A103 and A106 
standard deviations. With just two sets of points at each Mach number, it is not possible to say that one point is more 
accurate than the other. There is no statistical difference between the black and red symbols at each Mach number. 
Therefore, the smooth dashed curves were estimated by eye for each aerodynamic coefficient. 

B. Application of Repeatability to Database Error 

To quantify the total experimental error associated with the A 106 ascent aero database, the procedure was to 
count the number of times wind tunnel-based terms appear in the database buildup, resulting in the experimental 
uncertainty 3 -sigma limits as defined in Eq. (5), where n is the number of experimental-based terms in the database 
that count towards the total experimental error. 


U exp ~ 3yfncJ rep 

For the A106 database experimental error, n = 2 because there are two terms that must be counted towards the total 
experimental error. The equation buildup for the database at wind tunnel Reynolds numbers is shown in Eq. (6). In 
this equation there are two Cci terms, denoted in red, which cancel each other out. Additionally C C 4 , adjusted is not 
counted towards Uexp because it is assumed to be free of biases. This leaves two (n= 2) terms that contribute to the 
total experimental error in the A 106 ascent database. 

CdB.EXP = (Cci - C C 4 ) + C C 4, adjusted + (Cc7~ C cl ) ( 6 ) 

Therefore, the contribution of experimental error to the ascent database is defined as follows: 

U exp = 3v/2f7 rep (7) 

V. Database Modeling Errors 

Database modeling errors include all errors introduced in constructing a database response surface at canonical 
inference space points, from an experimental or CFD input dataset. Examples of database modeling errors are: 

1 . smoothing and/or curve-fitting of the input dataset 

2. assumptions used to create reduced-order models from sparse input data, in order to fill out the database 
inference space. 

A. Experimentally-Derived Baseline Response Surface 

The database modeling error for the portion of the A106 ascent aero database constructed from experimental 
data was determined by comparing the official database response surface for the Cl configuration at wind tunnel 
Reynolds numbers ( Cm.ci ) to an alternate Cl response surface constructed from wind tunnel pitch runs, without 
using smoothing. This other database will be referred to as the UQ response surface for the remainder of this paper. 
The UQ response surface was constructed from wind tunnel data that were not used to construct the A 106 Cl 
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database response surface. The database modeling errors were estimated by comparing the database values at 
conditions where data were acquired but not used, with UQ response surface values where the acquired data were 
used to construct the surface. 

The database team constructed the Cl response surface using pitch sweep data at zero degrees roll and 
increments computed from roll sweep data at pitch angles of 0° to 10°, and adding these to the adjusted C4 data. 

Cdb.CI = (Cci ~ Cc4) + C C 4, adjusted ( 8 ) 

The UQ response surface was constructed using only pitch sweep data that were obtained at roll angles every 
45°. No roll run data were used to create the UQ response surface. Additionally, no smoothing was performed on the 
wind tunnel data to create the UQ response surface. Figure 5 depicts the difference between the wind tunnel input 
data set inference space points used to construct the official and UQ version of Cdb.ci • The red squares indicate the 
roll and pitch angle combinations used to construct the official baseline Cl database, and the black circles represent 
the roll and pitch angles where points from the UQ response surface exist. The database modeling errors were 
captured by comparing the two databases at common breakpoints (i.e., where the red squares and black circles 
coincide in Figure 5). Residuals between the two databases at these common pitch and roll angles were computed 
(Eq. (9)) for each Mach number. The two databases were compared with the moment coefficients computed at the 
balance moment center, where the forces and moments are uncorrelated. 

DC DBM = C DB Cl - CuQDB (9) 

Plots of the database modeling errors are shown in Figures 6 through 9, where the residuals computed using Eq. 
(9) are plotted versus Mach number. Experimental error bounds are included on these plots, to compare the relative 
magnitude of the database modeling errors to experimental errors. Recall that DCdbm is computed from just the 
baseline Cl database component, Cdb.ci • The experimental error bounds associated with Cdb.ci are represented by 
dashed blue lines in Figures 6 through 9 and were computed using Eq. (7). 

Note in the figures that many of the residuals lie outside the experimental error bounds. This indicates that the 
uncertainties associated with smoothing the data and combining smoothed and fitted pitch and roll run data 
generally exceeded the experimental error (i.e., wind tunnel repeatability). If the database modeling residuals mostly 
fell below the experimental error bounds, then the database modeling errors would be considered insignificant, and 
the experimental and database interpolation errors would be the only sources of uncertainty for the wind tunnel- 
derived database. 

Flowever, since the database modeling residuals are generally greater than the experimental error bounds, U D bm 
must be included in the quantification of the overall database error. Database modeling error bounds ( U D bm ) were 
estimated by eye from the residual plots shown in Figures 6 through 9, and are represented as red dashed lines in 
these figures. Since experimental errors are already accounted for with Eq. (7), it is necessary to subtract the 
experimental error (i.e., wind tunnel data repeatability) from Udbm, so as not to exaggerate the modeling errors by 
double counting the effect of repeatability. The net database modeling error for the experimentally-derived portion 
of the ascent database is computed using Eq. (10), where the contribution of experimental error is subtracted from 
the total database modeling error. 


U 


DBMnet 


Ju 


2 -U 2 

DBM ^ EXP 


( 10 ) 


Recall that U EX p represents the error due to wind tunnel data repeatability and is defined in Eq. (7). As such, Eq. 
(10) can be written as follows, where n= 2. 


U 


DBMnet 


pLu -2( 3 <vJ 2 


( 11 ) 


The database modeling residuals lie within the experimental error bounds at the lowest Mach numbers for every 
coefficient except pitching and yawing moment. At these Mach numbers the database modeling errors are 
insignificant and the net database modeling error term becomes zero. 
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B. CFD-Derived Reynolds Number Increments 

It was not possible to conduct wind tunnel tests at flight Reynolds numbers because there was no facility 
available that could attain full flight Reynolds number for the A106 configuration. Therefore, CFD data were used to 
develop a wind tunnel-to-flight Reynolds number increment model, which is the last term of Cm in Eq. (2). CFD 
solutions for the full protuberance (Cl) configuration were computed at both wind tunnel and flight Reynolds 
numbers. The complete A 106 CFD dataset was searched to find instances where solutions existed for both wind 
tunnel and flight Reynolds numbers for the same configuration, at the same Mach number, pitch angle, and roll 
angle combinations. These data pairs were then grouped by Mach number and the flight Reynolds number 
coefficient values were plotted versus the wind tunnel Reynolds number values. Linear curve fits were computed for 
each aerodynamic coefficient and Mach number range (see Equation 12). 


C Fit Re,CFD ~ m (-WTRe,CFD + d — ^0 


( 12 ) 


Eq. (12) is re-written to be expressed as an increment as shown in Equation 13. The left-hand side of Eq. (13) is 
equivalent to the last term in Eq. (2), and is what was included in the database to model the effect of Reynolds 
number. The offset 5 was found to be essentially zero for all aerodynamic coefficients except CAF. This increment 
is what was included in the database to model 


ACFhRe, CFD ~ (W “ l)CWft, CFD + S ± U 0 (13) 

There were not sufficient CFD data available to develop a detailed validation error model for CFD increments. 
Therefore, the scatter in the increment models was used to set the error bounds, U DBM ,Re cfd, for the Reynolds 
number increment term in the database. The increment model scatter and corresponding error bounds are presented 
in Figures 10 through 13. The Reynolds number increment uncertainty is a function of total angle of attack 
(ALPHAT) and Mach number for side/normal force and pitching/yawing moment coefficient increments, as shown 
in Figures 10 and 11, respectively. Axial force and rolling moment increment modeling errors are only a function of 
Mach number, as seen in Figures 12 and 13, respectively. 

VI. Database Interpolation Error 

In practice, linear interpolation is used in the simulation environment to obtain values from the 6DOF database at 
non-canonical inference space points (i.e., between database breakpoints). To estimate the error associated with 
interpolating within the database, we queried the database at non-canonical points and then used both linear 
interpolation and a cubic spline to compute the aerodynamic coefficients. Figure 14 illustrates that the midpoints 
between the canonical database inference space points were used to estimate the database interpolation error. The 
black circles represent the database breakpoint values, and the red circles represent the midpoints used to compute 
the interpolation error. The official database release was presented as a function of angle of attack and sideslip, so 
the database interpolation error was computed in the alpha-beta inference space. The database values computed with 
a spline interpolation were subtracted from the values computed using linear interpolation. These residuals were 
plotted versus Mach number and the error bounds ( Udbi ) were estimated by eye from the charts, as shown in Figures 
15 through 18. The database interpolation error is quite small compared to the other error terms associated with the 
database. 


VII. Total Error Buildup for the A106 AFMA Aero Ascent Database 

The total error for the A106 AFMA aero ascent database is computed by using the root-sum-square method to 
combine the individual errors defined in the preceding sections, as shown in Eq. (14). 


U 


C.Q 



+u 


2 

DBMnet 


+ U 


2 

DBM, Re CFD 


+ul 


(14) 


Recall that the first two terms under the square are defined in Equations 7 and 11, respectively. The third term on 
the right hand side of Eq. (14) represents the modeling error associated with the CFD-derived Reynolds number 
increment model and was computed from the scatter in the increment model. The fourth term represents the 
interpolation error due to querying the database at non-canonical points. 
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The error buildup for the A 106 ascent aero database is shown in Figures 19 through 24. The total database error 
is compared with the individual error components in these figures. Figures 19 and 20 depict the errors for side and 
normal force coefficients at 0° and 4° total angle of attack. (Recall that the uncertainties for the flight Reynolds 
number increments are a function of both total angle of attack and Mach number.) Notice the net database modeling 
errors ( U nuMnet) are zero at the lower Mach numbers. This is a result of the database modeling residuals being less 
than or equal to the experimental error bounds. 

VIII. Concluding Remarks 

A detailed uncertainty analysis was developed for the Ares I A106 CLV ascent aero 6DOF database. This 
database was constructed using both experimental and CFD data. The errors for each component of the database 
were identified and quantified. The total error was obtained by root sum squaring the individual error terms. All of 
the error terms are expressed as a function of Mach number, and with the exception of the flight Reynolds number 
increment uncertainties for CNF, CYF, CLMF, and CLNF, none of the database errors were a function of angle of 
attack. In general, the database uncertainty consists of experimental errors (wind tunnel repeatability), modeling 
errors, and database interpolation errors. 
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Figure 1. Wind Tunnel Repeatability Standard Deviations for CNF and CYF. 
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Figure 2. Wind Tunnel Repeatability Standard Deviations for CLMF and CLNF. 
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Figure 3. Wind Tunnel Repeatability Standard Deviations for CAF. 



Mach Number 

Figure 4. Wind Tunnel Repeatability Standard Deviations for CLLF. 
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Red squares; Roll Run points used in AFMA DB construction 
Black circles: Pitch run points used in UQ DB construction 



Figure 5. Comparison of breakpoint values in actual A106 ascent database and pitch run-only UQ response 
surface. 
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Figure 6. Normal and side force database modeling residuals ( C DB C i - C U0DB ), in body axis coefficients. 
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Figure 7. Pitching and yawing moment database modeling residuals ( C DB ,ci - Cuqdb )> in body axis coefficients. 
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Figure 8. Axial force database modeling residuals (C DBtC i - Cuqdb)-> in body axis coefficients. 
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Figure 9. Rolling moment database modeling residuals ( C DB ,ci - Cuqdb), in body axis coefficients. 
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Figure 10. Effect of Mach number on fit errors for Reynolds number increment model for normal and side force 
coefficients. 
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Figure 11. Effect of Mach number on fit errors for Reynolds number increment model for pitching and yawing 
moment coefficients. 
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Figure 12. Effect of Mach number on fit errors for Reynolds number increment model for axial force coefficient. 
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Figure 13. Effect of Mach number on fit errors for Reynolds number increment model for rolling moment 
coefficient. 
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Figure 14. Alpha, beta coordinates where database interpolation error was computed (black circles are the 
canonical inference space points, red circles are points where the database was queried 
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A106 DB Interpolation Residuals; (linear - spline) lor CN and CY 



Figure 15. Database interpolation errors for normal and side force coefficients. 


A106 DB Interpolation Residuals; (linear - spline) CLM and CLN 



Figure 16. Database interpolation errors for rolling and yawing moment coefficients. 
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A1 06 DB Interpolation Residuals; (linear — spline) for CA 



Figure 17. Database interpolation errors for axial force coefficient. 



Figure 18. Database interpolation errors for rolling moment coefficient. 
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Mach Number 

Figure 19. Total A106 ascent aero database uncertainty and individual error components, for side and normal force at 
zero degrees angle of attack. 
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Uncertainty at AT = 4 deg for CNF and CYF 



Figure 20. Total A106 ascent aero database uncertainty and individual error components, for side and normal force at 
four degrees angle of attack. 
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Figure 21. Total A106 ascent aero database uncertainty and individual error components, for pitching and yawing 
moments at zero degrees angle of attack. 
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Figure 22. Total A106 ascent aero database uncertainty and individual error components, for pitching and yawing 
moments at four degrees angle of attack. 
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Figure 23. Total A106 ascent aero database uncertainty and individual error components, for axial force for all 
angles of attack. 
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Figure 24. Total A106 ascent aero database uncertainty and individual error components, for rolling moment for all 
angles of attack. 
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